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We present a fast and robust cluster update algorithm 
that is especially efficient in implementing the task of image 
segmentation using the method of superparamagnetic clus- 
tering. We apply it to a Potts model with spin interactions 
that are are defined by gray-scale differences within the im- 
age. Motivated by biological systems, we introduce the con- 
cept of neural inhibition to the Potts model realization of the 
segmentation problem. Including the inhibition term in the 
Hamiltonian results in enhanced contrast and thereby signifi- 
cantly improves segmentation quality. As a second benefit we 
can - after equilibration - directly identify the image segments 
as the clusters formed by the clustering algorithm. To con- 
struct a new spin configuration the algorithm performs the 
standard steps of (1) forming clusters and of (2) updating the 
spins in a cluster simultaneously. As opposed to standard al- 
gorithms, however, we share the interaction energy between 
the two steps. Thus the update probabilities are not indepen- 
dent of the interaction energies. As a consequence, we observe 
an acceleration of the relaxation by a factor of 10 compared 
to the Swendson and Wang procedure. 

The segmentation of images into connected areas or 
objects is a formidable task and an important step in the 
process of recognition. Nature provides us with many 
examples of biological systems that solve this and other 
tasks related to the recognition problem in highly efficient 
ways. Taken as such, the problem is ill-defined: one will 
distinguish different numbers of objects in a noisy pic- 
ture depending on the level of contrast and resolution. 
A physicists answer to the problem has been presented 
by the method of 'superparamagnetic clustering of data' 
where the pixels of an image are represented by a 
Potts model of spins which interact in such a way that 
neighboring spins corresponding to similar pixels tend 
to align. Then the image-segments (or objects) may be 
identified as subsets or clusters of correlated spins at a 
given temperature. At high temperature one will find 
a disordered paramagnetic phase while, when lowering 
the temperature, superparamagnetic phases occur with 
clusters of aligned spins. 

From a theoretical point of view any method of sim- 
ulating a given spin system is equivalent as long as it 
preserves general concepts such as detailed balance. For 
practical purposes it is of course desirable to choose a 
method that is efficient and best adapted to the model. 
Cluster update algorithms are commonly used to to ac- 
celerate the equilibration of large spin systems |^|-^ . As 
opposed to single spin updates following a Metropolis 
procedure, these algorithms provide a method to update 
connected clusters of aligned spins simultaneously. 

Our approach to the problem is twofold: On the one 
hand we introduce to the spin model the concept of (1) 



global inhibition, motivated by the analogy to neural vi- 
sual systems 0, on the other hand (2) we have devel- 
oped a novel cluster algorithm that utilizes the energy 
landscape, which underlies the equilibration process, in 
a more efficient way. 

(1) The concept of global inhibition is found in many 
biological neural networks and has successfully been ap- 
plied also in neural computation |^ . We implement it by 
adding a small global penalty for spins to align. It serves 
to identify different clusters by different spin labels with- 
out need to observe the spin correlations over a longer 
time period. 

(2) In a cluster update algorithm the clusters are 
formed by "freezing" bonds between aligned spins with 
some probability. Commonly the clusters are then up- 
dated independently. We update the clusters taking into 
account also the interactions on bonds that were not 
frozen. In addition the inner surface of the larger clusters 
is reduced by incorporating islands that they might con- 
tain. Both of our improvements are implemented while 
preserving detailed balance. As a result, we observe a 
significant increase in quality and speed. 

Without loss of generality in the following we will use 
the problem of segmenting an image into individual ob- 
jects as an example to describe our approach. Specif- 
ically, given a picture in form of color (or gray-scale) 
values gi, . . . ,gN on the A'' sites of a finite 2c? lattice, we 
have the clustering problem: find 'objects' i.e. clusters 
of almost the same color. 

We define for each pair of nearest neighbors or bond 
on the lattice the distance Ay = \gi — gj\ and the 
mean distance averaged over all bonds. 

To perform the clustering task we assign a spin variable 
Gi to each site i and for each bond an interaction 

strength 



Ay /A, 



(1) 



With the normalization in eq.(|l|) the color of sites i,j 
is assumed to be similar when the gray value distance 
Ay is smaller than the average. Then the interaction 
strength is positive with a maximum value of 1 for equal 
color. We implement the spin model in such a way that 
for neighboring sites with similar color the spins have the 
tendency to align. For this purpose we use a g-state Potts 
model with the Hamiltonian 



H 



(2) 



Here, denotes that i,j are nearest neighbors con- 

nected by a bond (i,j) and 5ij is the Kronecker delta 
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function. The second term is introduced in analogy to 
neural systems, where it is generally called "global inhi- 
bition" . It serves to favor different spin values for spins 
in different clusters as explained below. This is a concept 
realized in many neural systems that perform recognition 
tasks. The segmentation problem is then solved by find- 
ing clusters of correlated spins in the low temperature 
equilibrium states of the Hamiltonian H. 

We perform this task by implementing a clustering al- 
gorithm: In a first step the 'satisfied' bonds, i.e. those 
that connect nearest neighbor pairs of identical spins 
CTj = Gj are identified. The satisfied bonds («, j) are then 
'frozen' with some probability pij. 

Sites connected by frozen bonds define the clusters. 
Each cluster is then updated by assigning to all spins 
inside the cluster the same new value. Commonly this 
is done independently for each cluster [||. In that sense 
the external bonds connecting the clusters are 'deleted'. 
Here, we use a more general cluster algorithm. When 
choosing a new spin configuration we take these bonds 
into account. To preserve detailed balance, we adjust 
the bond freezing probabilities Pij and the interaction on 
the external bonds. 

Our cluster update algorithm, which we call energy- 
sharing cluster update (ECU) is divided in two basic 
steps. Similar to the Swendson & Wang cluster algo- 
rithm Q also in our approach the temperature remains 
fixed and no annealing takes place between the iterations. 

(la) As for any cluster update we first identify the satis- 
fied bonds with (7i ~ Uj and freeze these with 
probability 

jiff = l-e-^<^E^. 

when Jij > and Eij = JijSaio-j- Here 1//3 — ksT 
is the product of the Boltzmann constant ks and 
temperature T. 
The additional coefficients 

(1) _ f a^^'> if (i, j)is a bond 
~ \ else 

with a^^-* < 1 allow us to "share" the interac- 
tion energy with the following additional steps. If 
one chooses a^^-' — 1 then one obtains the usual 
Swendson- Wang clusters which may then be up- 
dated independently. 

(lb) In an intermediate step we identify 'invisible' is- 
lands i.e. clusters according to step (la) that have 
a boundary only with one other cluster and have 
the same spin value. These islands often delay the 
spin flip of the larger cluster in step (2) as their 
total boundary may be large. For this reason we 
want to remove them with some finite probability. 
This step is not indispensable for our algorithm but 
it further improves its performance. We freeze the 



bonds between an island and the surrounding clus- 
ter with probability 

(2) , _/3„(2)^ 

p^y = 1 - e '^^'J 

where qff = a*^^^ if is a bond connecting 

an island with a surrounding cluster after step (1) 

(2) 

and otherwise q^j' — 0. We impose the condition 

a^^^ -I- a^^^ < 1. Note that we do not increase the 
bond freezing probability beyond the Swendson- 
Wang probability and no size limit for the islands 
is implied. 

(2) Finally we identify the clusters ci, . . . , Cfc of spins 
connected by frozen bonds after steps (la) and 
(lb). On this system of clusters that in similar 
approaches is referred to as a hyperlattice [|| we 
perform a Metropolis update that updates all spins 
in each cluster simultaneously to a common new 
label. The Metropolis rate is calculated using the 
modified Hamiltonian 

H{<J) = -J2 + ^ E (3) 

As has been shown on general grounds in |^ de- 
tailed balance is preserved under the condition that 
in the modified Hamiltonian one uses g^^' -I- qff + 

(2) . 

ql^ — 1. This amounts to sharing the interaction 
energy between the clustering and updating steps. 
Note that the inhibition term in eq. (^ does not 
enter the bond freezing probabilities. For the clus- 
ter update it has the effect of favoring a different 
spin value for each cluster. 

We have tested the performance of the proposed seg- 
mentation method based on the Hamiltonian H in eq. (2) 
with a finite inhibition of k = 0.2 in combination with 
the ECU cluster update algorithm with energy sharing 
parameters a^^^ — a*-^-* = 0.5. To our experience the 
efficiency of the algorithm does not depend sensitively 
on these parameters. Further refinements may be added 
to improve the segmentation delivered by the ECU algo- 
rithm to cope with more delicate recognition problems 
|lO| . We have compared the algorithm to the perfor- 
mance of other known segmentation methods. As meth- 
ods of reference we have used in particular the method 
of simulated annealing and the method of superparamag- 
netic clustering |^ without inhibition (k = 0) using the 
standard Swendson&Wang (SW) update. In addition we 
have tested a variant of the SW update that allows to 
freeze anti-ferromagnetic bonds (i, j) when Jij < 0. 

An example that illustrates the different solutions to 
the segmentation problem is shown in Fig. 1. Let us 
explain this comparison in some detail. The gray scale 
values that define the interactions Jij according to eq. 
(1) are taken from Fig. lA. 
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FIG. 1. Comparison of different segmentation methods. 
As parameters we use A*' = 128 x 128 and q = 10 (states of tlie 
Potts model). A) Tlie input image for all simulations consists 
of two rectangles with gray values gf — 72, 152 and a one pixel 
thin line surrounding them with gf = 112. Noise is added 
<7i = <?? + £,i that is equally distributed: = —12. .12. B) 
The initial random configuration. C) and D) Configurations 
of a local update algorithm (Metropolis: "Gibbs-Sampler" ) 
at different iterations. E) Configurations of the SW cluster 
update algorithm. F) Configurations of the SW cluster up- 
date using antiferromagnetic clustering. G) Configurations of 
the ECU-algorithm including inhibition k = 0.2. H) The rel- 
ative energy of the spin-lattice as a function of the number of 
iteration steps for the different algorithms in C,F and G at 
fcsT = 0.2. 

Some noise is included in this input. All segmentation 
methods that we consider use q = 10 state spin vari- 
ables ai — 1, . . . , 10. A random initial configuration of 
the spins is shown in terms of a gray scale picture in Fig. 
IB. As a first reference we show the sequence of a simu- 
lated annealing procedure in Fig. IC and ID. Here, the 
Hamiltonian H in eq. (2) with k = is used to define 
the Metropolis rate of local spin updates . After 

each sweep of N spin updates the temperature is lowered 
by a constant factor A jlj] . We started with a tempera- 
ture ksTo = 1.0 and lowered by A = 0.99992 in IC and 
A = 0.8 in ID for each sweep. The spin configurations 
at intermediate steps are shown in Fig. IC and ID. In 
the slower annealing procedure the two large rectangles in 
the image are segmented according to the original picture 
while the finer structure is not recognized by this algo- 
rithm. When the faster schedule is applied as in ID then 
even the larger connected areas are divided into artificial 



segments. Obviously the simulated annealing method is 
inefficient for the segmentation task and due to slowing 
down at low temperatures the local update is very time 
consuming. Even optimizing the annealing rate during 
the schedule cannot change this picture as an extremely 
slow rate is needed to indentify the fine structure of the 
thin border line. 

In Fig. lE-G we compare different cluster update al- 
gorithms that avoid the problem of slowing down and we 
test the influence of the inhibition term and the energy 
sharing that are included only in Fig. IG. Comparing 
the series of spin configurations in Fig. IE and IG one 
notices that the inhibition term in IG indeed introduces 
a forced contrast between different segments as compared 
to IE, in particular at fc^T = 0.25 and fc^T = 0.2. Also 
the increase in speed is remarkable. 
In Fig. IF we test a cluster update algorithm ^3 14 1 that 
includes anti-ferromagnetic clustering where in the clus- 
tering step (la) anti-ferromagnetic bonds with Jij < 
and ai ^ aj are frozen with probability pij = 1 — 
exp[/3Jij]. The clusters defined by ferro- and anti- 
ferromagnetic bonds are updated while preserving ai — 
aj on the ferro- and ai ^ aj on the anti-ferromagnetic 
bonds. This method introduces additional contrast be- 
tween areas of different input color but it fails at low tem- 
perature where artifacts are generated due to the noise in 
the input. The convergence characteristic of the different 
algorithms is shown in Fig. 0H, where the energy of the 
spin-lattice is plotted as a function of time at fixed tem- 
perature. The relaxation time of the ECU-algorithm is 
about 10 times faster than that of the other algorithms. 

Let us note that the only parameters that enter our 
segmentation method are the factors of proportionality 
a'^', a^^-* that determine the share of energy for the bond 
freezing steps and the inhibition strength n. Mainly the 
a-parameters are relevant for the efficiency of the seg- 
mentation while K indroduces some contrast to the rep- 
resentation of the clusters in terms of spin values. We 
have not attempted to optimize the choice of the param- 
eters to speed the segmentation of Fig. lA. Rather we are 
interested in a general purpose algorithm and we have 
successfully tested the robustness of the ECU segmenta- 
tion with the present choice of parameters for many dif- 
ferent pictures. To demonstrate this robustness we show 
three examples in Fig. 2. Despite the bad quality of the 
input a usable segmentation was found within a small 
number of iterations. A seemingly continuous gray scale 
background in Fig. 2A is segmented into only few clus- 
ters identifying the foreground character. In Fig. 2B we 
illustrate that for practical purposes, in this case detec- 
tion of the license plate, even an intermediate iteration 
step, here fc = 12, may be used without need to wait for 
equilibration (at k f« 30). Fig.2C shows the quality of 
segmentation for a highly complicated picture. 

Data clustering becomes tremendously complicated 
when the intrinsic correlation between the data points 
which belong to the same cluster is small. A situation 
like this always occurs if the clusters extend into a thin, 
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thread-like shape or an almost fractal structure, for ex- 
ample when dealing with images of biomolecules, poly- 
mers, or stellar structures. The ECU makes better use of 
the energy landscape which underlies the clustering prob- 
lem by sharing energy between the bond-freezing and the 
spin-update steps of the algorithm. The additionally in- 
troduced global inhibition enhances contrast. As a con- 
sequence the quality of the results improves and, most 
notably, energy sharing leads to an acceleration of the 
segmentation by about a factor of ten (Fig. 0H). 
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FIG. 2. Applications of the ECU segmentation method. 
For each picture (A-C) the input image and the segmention 
result of the q-state Potts model after k iterations is shown. 
(B) shows an intermediate, (A) and (C) show the final result 
of segmentation after equilibration. (A) Moose in the morning 
fog. q=10,k=40. (B) Front of a car. The task is to identify 
the license plate. q=10,k=12. (C) NMR-image of the human 
brain. q=20,k=65. 

In the course of development of the modern cluster 
update algorithms similar ideas have been proposed on 
sometimes more general grounds. Kandel and Domany 
Q lay out how to preserve detailed balance for a broad 
class of algorithms and they show how several other pro- 
posed update variants Q may be rephrased to comply 
with this. The ECU algorithm is also embedded in 
this framework. Niedermayer ^ shows that in the clus- 
tering step (la) any function p\^\Eij) can be used in 
principle, but proposes for practical purposes to apply 
plj^ = 1 — exp[— /3(i?ij — Eq)] with some appropriately 
chosen Eq . With this choice the contribution of the non- 



frozen bonds to the update is clipped at Eq. In our case 
we share the energies in a proportional way between the 
clustering and update steps. The alignment of clusters is 
thus enhanced by also including the stronger bonds with 
higher energy content. 

In summary, the recognition task of segmenting an im- 
age may be performed with high efhciency by a simple 
cluster update algorithm if global inhibition is imple- 
mented. Furthermore, we believe that our cluster up- 
date approach may also be useful for the simulation of 
other spin models as its efficiency is not dependent on 
the special properties of the Potts model we use here. 
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